﻿Multivariate statisticsFrom Wikipedia, the free encyclopedia
Jump to: navigation, search 
Multivariate statistics is a form of statistics encompassing the simultaneous observation and analysis of more than one statistical variable. The application of multivariate statistics is multivariate analysis. Methods of bivariate statistics, for example simple linear regression and correlation, are special cases of multivariate statistics in which two variables are involved.

Multivariate statistics concerns understanding the different aims and background of each of the different forms of multivariate analysis, and how they relate to each other. The practical implementation of multivariate statistics to a particular problem may involve several types of univariate and multivariate analysis in order to understand the relationships between variables and their relevance to the actual problem being studied.

In addition, multivariate statistics is concerned with multivariate probability distributions, in terms of both:

how these can be used to represent the distributions of observed data; 
how they can be used as part of statistical inference, particularly where several different quantities are of interest to the same analysis. 
Contents [hide]
1 Types of analysis 
2 Important probability distributions 
3 Software & Tools 
4 See also 
5 References 
6 External links 
 
[edit] Types of analysisThere are many different models, each with its own type of analysis:

Multivariate analysis of variance (MANOVA) methods extend analysis of variance methods to cover cases where there is more than one dependent variable to be analyzed simultaneously: see also MANCOVA. 
Multivariate regression analysis attempts to determine a formula that can describe how elements in a vector of variables respond simultaneously to changes in others. For linear relations, regression analyses here are based on forms of the general linear model. 
Principal components analysis (PCA) finds a set of synthetic variables that summarise the original set. It rotates the axes of variation to give a new set of ordered orthogonal axes that summarize decreasing proportions of the variation. 
Factor analysis is similar to PCA but attempts to determine a smaller set of synthetic variables that could explain the original set. 
Canonical correlation analysis finds linear relationships among two sets of variables; it is the generalised (i.e. canonical) version of correlation. 
Redundancy analysis is similar to canonical correlation analysis but deriving a minimal set of synthetic variables from one set of (independent) variables that explains as much variance as possible in the other (dependent) set. It is a multivariate analogue of regression. 
Correspondence analysis (CA), or reciprocal averaging, finds (like PCA) a set of synthetic variables that summarise the original set. The underlying model assumes chi-squared dissimilarities among records (cases). There is also canonical correspondance analysis (CCA) for summarising the joint variation in two sets of variables. 
Multidimensional scaling covers various algorithms to determine a set of synthetic variables that best represent the pairwise distances between records. The original method is principal coordinates analysis (based on PCA). 
Discriminant function or canonical variate analysis attempts to establish whether a set of variables can be used to distinguish between two or more groups. 
Linear discriminant analysis (LDA) computes a linear predictor from two sets of normally distributed data to allow for classification of new observations. 
Clustering systems assign objects into groups (called clusters) so that objects from the same cluster are more similar to each other than objects from different clusters. 
Recursive partitioning creates a decision tree that strives to correctly classify members of the population based on a dichotomous dependent variable 
Artificial neural networks extend regression and clustering methods to non-linear multivariate models. 
[edit] Important probability distributionsThere is a set of probability distributions used in multivariate analyses that play a similar role to the correposonding set of distributions that are used in univariate analysis when the normal distribution is appropriate to a dataset. These multivariate distributions are:

Multivariate normal distribution 
Wishart distribution 
Multivariate Student-t distribution. 
Further, the Inverse-Wishart distribution is important in Bayesian inference, for example in Bayesian multivariate linear regression. Additionally, Hotelling's T-square distribution is a univariate distribution, generalising Student's t-distribution, that is used in multivariate hypothesis testing.

[edit] Software & ToolsThere are an enormous number of software packages and other tools for multivariate analysis, including:

Calc 
MiniTab 
R 
SAS (software) 
sciPy for Python 
SPSS 
Stata 
Statistica 
The Unscrambler 
[edit] See alsoEstimation of covariance matrices 
Important publications in multivariate analysis 
Multivariate testing 
Structured data analysis (statistics) 
RV coefficient 
